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Transition Phenomena Induced by Internal Noise and Quasi-absorbing State 

Jun Ohkubo 1 *, Nadav Shnerb 2 1 and David A. Kessler 2 ^ 

1 Institute for Solid State Physics, University of Tokyo, Kashiwanoha 5-1-5, Kashiwa, Chiba 277-8581 
2 Department of Physics, Bar-Ilan University, Rarnat-Gan 52900, Israel 

We study a simple chemical reaction system and effects of the internal noise. The chemical 
reaction system causes the same transition phenomenon discussed by Togashi and Kaneko 
[Phys. Rev. Lett. 86 (2001) 2459; J. Phys. Soc. Jpn. 72 (2003) 62]. By using the simpler model 
than Togashi-Kaneko's one, we discuss the transition phenomenon by means of a random walk 
model and an effective model. The discussion makes it clear that quasi-absorbing states, which 
are produced by the change of the strength of the internal noise, play an important role in the 
transition phenomenon. Stabilizing the quasi-absorbing states causes bifurcation of the peaks 
in the stationary probability distribution discontinuously. 
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1. Introduction 

Noise has many roles in many stochastic processes, 
and the analysis of the behavior of complex stochastic 
systems is one of the most interesting issues in statis- 
tical physics and related areas. Chemical reactions are 
described traditionally in terms of kinetic rates, and a 
deterministic rate equation approach is often used. While 
effects of noise or fluctuation can not be treated directly 
by the deterministic rate equation approach, a stochastic 
system could cause a drastic modification of macroscopic 
properties due to the noise and fluctuation effects. 

For example, there is a simple model for the transition 
phenomenon induced by external noise. ^ The behavior 
of the following chemical reaction system 

A + X + Y^2Y + A* ( 
B + X + Y ^2X + B* W 

can be represented adequately by a deterministic phe- 
nomcnological equation 

^ = a-X + XX(l-X), (2) 

where the variable X is the concentration of chemical 
substance X in the chemical reaction system (1). When 
A* and B* are in large excess so that their fluctuations 
can be neglected, a becomes a constant. The fluctuation 
effects of A and B are included in A. If we neglect the 
fluctuations of A and B, the coefficient A seems to be 
a constant, and then eq. (2) describes a deterministic 
motion of a chemical substance X. In this case, eq. (2) 
gives only one stable solution. 

In order to include the fluctuation effect of A and B, 
one assumes that the external fluctuations are extremely 
rapid and then the effects are written by A = A* + er£, 
where £ means a white Gaussian noise with zero mean 
and variance 1. For the sake of simplicity, we take a = 
1/2 and A* = 0. In this case, the stationary probability 
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density has one peak or two peaks depending on the value 
of a; 1 ) 

J^pcak = 1 for a 2 < 4) 

\Xl c ak = I [1 ± (1 - 4/a 2 ) 1 / 2 ] for a 2 > 4, ' " ' 

i.e., when the fluctuation is small (a 2 < 4), the probabil- 
ity density has only one peak, and in contrast the prob- 
ability density has two peaks if the fluctuation is large 
(a 2 > 4) . The change of the number of peaks means the 
transition phenomenon induced by the external noise. 1 ' 
As the above example shows, a deterministic equation 
is not enough to treat a stochastic process adequately. 
There are many examples for such stochastic processes, 
e.g., a chemical reaction system, a prey-predator system, 
disease spreading system, an so on. These systems are 
described by a reaction scheme such as eq. (1), and then 
they consist of discrete components such as molecules 
(chemical substances) and individuals. So far, the impor- 
tance of the discreteness has been pointed out by several 
authors. 2 ~ 10 ) 

Togashi and Kaneko 11-13 ) have shown that a novel 
transition phenomenon occurs in a chemical reaction sys- 
tem with small size. In their work, a small autocat- 
alytic system, which consists of at least four chemical 
substances, has been investigated. Togashi and Kaneko 
have shown that there is a nontrivial transition phe- 
nomenon induced by the molecular discreteness. How- 
ever, the models in references 11, 12, and 13 are a lit- 
tle complicated to be treated analytically, so that only 
numerical experiments have been performed in order to 
research the transition phenomenon. In order to inves- 
tigate the transition phenomenon quantitatively and to 
make an intuitive picture for the transition phenomenon, 
it would be needed to construct a simple model which is 
easier to treat analytically. 

In the present paper, we propose a simpler model than 
Togashi-Kaneko's one; the simple model shows the same 
transition phenomenon which was discussed by Togashi 
and Kaneko. The model consists of only two chemical 
substances, and hence we can treat the model analyt- 
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Fig. 1. Illustrative explanation of an autocatalytic process in a 
container. A container is in contact with a reservoir of molecules, 
and the chemicals M\ and M3 diffuse in and out through the 
membrane of the container. The reaction network in the left side 
can be reduced to that in the right side with some assumptions. 



ically with a certain assumption. By numerical experi- 
ments, we confirm that the same transition phenomenon 
occurs even in our simple model. Furthermore, using an 
assumption that there is a restriction of the total num- 
ber of molecules, it is possible to write down the master 
equation with only one variable. The master equation 
is easy to be analyzed, and the transition point can be 
estimated adequately. In addition, we can construct a 
random walk model from the master equation, and the 
random walk model gives us intuitive pictures of the role 
of the internal noise. By the intuitive pictures, we con- 
clude that quasi-absorbing states produced by the inter- 
nal noise play an important role for the transition phe- 
nomenon, rather than the discreteness effects. In order 
to check this fact, we use an effective chemical reaction 
model and analyze it by the Fokker-Planck equation ap- 
proach; the effective chemical reaction model can cause 
the same transition phenomenon even in the large system 
size. 

The present paper is organized as follows. In § 2, we 
propose an autocatalytic model which shows a transition 
phenomenon induced by the internal noise, and give re- 
sults of numerical experiments. Section 3 gives an analyt- 
ical treatment for the autocatalytic model. In addition, 
we propose an effective chemical reaction model, which 
clarifies the quasi-absorbing states are important rather 
than the discreteness. Finally, we give some concluding 
remarks in § 4. 

2. Autocatalytic model 

2.1 Model 

We consider a simple chemical reaction network shown 
in Fig. 1. We denote the number of chemical substance 
Mi as Ni, and the concentration of each chemical sub- 
stance as Xi = Ni/V, where V is the volume of the con- 
tainer. Although there are four chemical substances Mi, 
M2, M3, M4 in the chemical reaction network in Fig. 1, 
the chemical reaction network would be described ade- 
quately only with two variables Ni and A 3 by introduc- 
ing some assumptions. 

For example, we consider the following additional re- 



(4) 



action for the reaction Mi ^ M^: M\ + Mtmp ^ M^. 
We assume that the chemical substance Mtmp is in large 
excess, and the reaction M\ + Mtmp ^ M2 occurs very 
rapidly. Because of the rapid attachment and detachment 
of Mtmp, we consider that the number of chemical sub- 
stance M2 is the same as that of Mi, i.e., N\ — A^. When 
the molecule M3 is near the molecule M\, the chemi- 
cal substance Mtmp would attach to the molecule Mi 
rapidly, and the reaction with M2 + M3 occurs. As for 
the chemical substance M4, we also assume the similar 
assumption, i.e., A3 = N4,. As a result, we presume the 
reaction network in the left side of Fig. 1 can be reduced 
to that in the right side of Fig. 1 . 

Using the above discussions, the autocatalytic chemi- 
cal reaction can be described simply as 

'Mi + M 3 -> 2M 3 

with rate r\X\XzV = nNiNa/V, 
M 3 + Mi -> 2Mi 

with rate r^xxx^V = r 3 NiN 3 /V, 
(outside) — > Mi 

with rate DiVsi (i — 1, 3), 
Mi —* (outside) 

with rate DiVxi = DiNi (i ~ 1,3), 

where is the reaction rate, D the diffusion rate across 
the surface of the container, and Si the concentration of 
the molecule in the outside of the container. A container 
is in contact with a reservoir of molecules, and the chem- 
ical substances Mi and M3 diffuse in and out through 
the membrane of the container. 14 -' Although the reac- 
tion network might be artificial, the model is useful in 
order to investigate the effects of the internal noise. 

In what follows, we assume that r\ = = 1, Si = S3 = 
1 and D\ = D3 = D for simplicity, while the transition 
phenomena to be presented in the paper will persist if 
we drop these conditions. Because we set r\ = r%, the 
rate with which the chemical substance M3 is generated 
by the autocatalytic reaction is the same as the rate for 
the generation of the chemical substance Mi . Hence, the 
deterministic rate equation is denoted by 

^- = D(l-x t ), (i = l,3). (5) 

The deterministic rate equation would be valid when one 
takes a continuum limit, given by V —* 00. In this limit, 
the fluctuation of concentration Xi is negligible. Obvi- 
ously, the deterministic rate equation means that the 
fixed point is Xi = 1. 

2.2 Numerical results 

The chemical reaction system (4) consists of a Markov 
jump process in continuous time. Such dynamics can 
be simulated (exactly) on a computer using standard 
discrete-event simulation techniques. The most standard 
implementation of this strategy is known as the Gille- 
spie algorithm. 15 ^ In the Gillespie algorithm, the lapse 
time to the next event is determined by exponentially 
distributed random numbers, and one determines which 
event occurs depending on the rate of the event. 
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Fig. 2. Sample paths of the number of molecules N\ and JV3. Here 
si = S3 = 1, D = 1/64 and V = 32. The paths fluctuate around 
Ni = or Ni = 64. 
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Fig. 3. The probability distribution of z = xi — X3. Here D = 
1/64. When the system size is large (V > 128), there is only one 
peak. In contrast, there is two peaks at z = ±2 for the small 
system size (V < 128). 



We apply the Gillespie algorithm to the chemical reac- 
tion network (4), and study the transition phenomenon 
induced by the internal noise and the discreteness nu- 
merically. In the whole numerical experiments, we set 
D = 1/64, and investigate the effect of the change in the 
volume V. 

We here investigate the time evolution of the number 
of molecules Ni and A 3 in the case with V = 32. One 
might expect that the concentrations X\ and x 3 fluctu- 
ate around the outside concentration, which is expected 
by the deterministic rate equation approach. However, 
Fig. 2 shows a different behavior; the paths seem to fluc- 
tuate around Aj = or Aj = 64. 

In order to clarify the unexpected behavior of iVi and 
A3 (xi and x 3 ), we calculate the probability distribution 
of the difference between two concentrations, z = x\ — x 3 . 
As anticipated by the deterministic rate equation (5), 
when the system volume is large the concentration of 



chemical substances Mi and M3 is determined by the 
outside concentration si = 1 and S3 = 1. In the present 
case, z should tend to take the value around zero, because 
Si = s 3 . Figure 3 shows the probability distribution of 
z. When the system volume V is large, the probability 
distribution has a peak at z = 0. On the other hand, 
the probability distribution has two peaks if the system 
volume V is small. The two peaks around z = ±2 mean 
that the number of only one chemical substance Mi or 
M3 fluctuates around (si + ss)V, and that of the other 
chemical substance is nearly zero (see Fig. 2). Note that 
the peak around z — becomes smaller and smaller as 
the volume V decreases, and the two peaks around z — 
±2 seem to emerge suddenly; this is different from the 
transition phenomenon of the reaction network (1) in § 1, 
in which one peak gradually splits into two peaks. 

As stated above, one of the features of the transition 
phenomenon is the discontinuous split of peaks, which 
is different from the transition phenomenon induced by 
the external noise. The feature has also been observed in 
Togashi-Kancko model. Togashi-Kancko model in refer- 
ence 11 has four chemical substances, so that Togashi- 
kaneko model might have different characters from our 
simple model. However, we consider that the scenario 
for the transition is the same; the decrease of the volume 
causes the increase of the internal noise, and then the 
discontinuous split occurs. 

3. Discussions for the transition phenomenon 

3.1 Master equation approach 

In the previous section, we have numerically confirmed 
the phenomenon induced by the internal noise. In this 
section, we try to treat the model analytically, because 
analytic treatments for a simple toy model would give us 
intuitive pictures for the transition phenomenon. 

In order to investigate the chemical reaction network 
introduced in § 2 analytically, we introduce an assump- 
tion such that "the total number of molecules is con- 
served." The assumption means that N = N\ + A3 — 
(si + S3)V^ is time-independent. From the assumption, 
we suppose that the outflow of one M\ molecule imme- 
diately induces the inflow of one M 3 molecule, and so 
forth. We therefore derive the following master equation 
for Mi (n = Ai): 



dP(n) 
dt 



--F(n) + G(n) 



(6) 



where 



F(n) 



y(n + l){( Sl + s 3 )V 



(n + l)}P(n + l) 



+ -(n - l){(*i + s 3 )V - (n - l)}P(n - 1) 
- + s 3 )V - n}P(n), (7) 



and 



G(n) =D'(s 3 V + n + l)P(n + 1) 

+ D'{(2si + s 3 )V - (n - l)}P(n - 1) 
-2D'{ Sl +s 3 )VP{n). (8) 
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Fig. 4. The difference of the transition rates between n — > n + 1 
and n — » n — 1. See the master equation (6). 



Note that the conservation of the total number of 
molecules effectively changes the diffusion constant D, 
and hence we denote it as D' . The reason why we divided 
the master equation into two parts {F(n) and G{n)) is 
explained later. 

The transition point V c is estimated as follows. Here, 
we define the transition as the emergence of the peak at 
n = 0. In order to calculate the transition point with 
the parameters s\ = S3 = 1, we use the detailed balance 
between the states n = and n = 1: 

^-{2V - l)P(l) + D'(V + l)P(l) = 3D'VP{0). (9) 

The emergence of the peak at n = is characterized by 
the fact of P(Q) > -P(l)- Hence, the transition point is de- 
termined by the condition P(0) = -P(l), and we estimate 
the transition point V c as V c = 1/D'. The conservation of 
the total number of molecules means that the diffusion of 
Mi becomes larger; the diffusion of M 3 causes the diffu- 
sion effect for Mi due to the conservation. The effective 
diffusion constant should therefore be set as D 1 ~ D/2, 
and we obtain 



V c ~ 2/D. 



(10) 



In our case, V c ~ 128 because of D = 1/64. This result 
is consistent with the numerical results in Fig. 3. 

Analyzing the master equation (6) , we obtain a simple 
random walk picture. In order to make an intuitive pic- 
ture, we investigate the difference of the transition rates 
between n — ► n + 1 and n — ► n — 1. Figure 4 shows that 
the transition rates. The first term of eq. (6), F(n), corre- 
sponds to a random-fluctuating force, because the tran- 
sition rate of n — » n + 1 is the same as that of n — » n— 1. 
On the contrary, the second term of eq. (6), G(n) has an 
interesting property. As shown in Fig. 4, there is a dif- 
ference between the transition rate n — > n + I and that 
of n — > n — 1; we define the difference as -E(n) and then 



E(n) = 2D'P(n){s 1 V -n). 



(11) 



Note that the difference E(n) changes its sign due to the 
value of n\ when n < sxV, there is a flow from n — 1 to 
n + 1. The change of the sign of -E(n) means that there 
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Fig. 5. Random walk model for transition phenomenon induced 
by the internal noise. When we assume that the total number of 
molecule Mi + M3 is conserved, the chemical reaction in § 2 is 
reduced into the random walk model. There are two forces acting 
on the random walker: one is an attracting force which pulls the 
random walker toward the potential minimum (solid arrow), and 
the other is a fluctuating force (dashed arrow). 



is an attracting force toward n — s±V . Hence, we will 
have a simple potential picture for the effect of the term 
G(n). 

We summarize the characteristics of the random walk 
model: 

(1) There is an attracting force which pulls back the 
number of molecules n into the outside on s^V. 

(2) There is an internal noise which does not appear 
in the deterministic rate equation (5). The internal 
noise changes the number of molecules n = Ni into 
nil with the rate 2NiN 3 /V. 

In Fig. 5, we show the intuitive picture for the random 
walk model. The position of the random walker, n, rep- 
resents the number of molecules Ni. The random walk 
model has two forces: one is the attracting force which 
pulls the position of the random walker toward the po- 
tential minimum; the other is a random fluctuation and 
shows the effects of the internal noise. The dashed arrow 
in Fig. 5 shows the random fluctuation, and the solid 
arrow means the attracting force. Considering the char- 
acteristics of the random walk model, we conclude that 
the random fluctuation becomes smaller and the attract- 
ing force becomes larger as n approaches the boundaries 
(0 or (si + S3 )n 

From the random walk model, we have intuitive pic- 
tures for the transition phenomenon induced by the in- 
ternal noise. The internal noise plays an important role in 
order to escape from the potential minimum [n — s±V) 
because the attractive force immediately pulls the ran- 
dom walker toward the potential minimum if the random 
fluctuating force is small. However, the decrease of the 
internal noise near the boundary would be also impor- 
tant. When the random walker becomes near the bound- 
ary, the random fluctuating force becomes smaller than 
that near the potential minimum, and hence the random 
walker tends to stay in such regions for a longer time 
compared with the region near n = s\V . 

3.2 Effective model 

Considering the random walk model carefully, we can 
construct a most natural one variable model which causes 
the transition phenomena. The chemical reaction model 
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is as follows: 



A^B, 
B^A, 
A + B A 2A, 
A + B A 2B. 



(12) 



(13) 



The rate equations for this model are 

±A = -kA + kB, 
%B = kA- kB, 

where we denote the number of particles A (or B) by the 
same symbol A (or B). When we assume that the total 
number of particles, which we denote by N(= A + B), is 
conserved, the rate equations are reduced to the following 
equation: 



— A = k(N-2A). 
dt 



(14) 



The deterministic dynamics is driven to the equally 
mixed state. The s reaction, on the other hand, leads 
to a segregation dynamics. 

The master equation for the number of A's is 

d 



dt 



P t =k[-NP t + + l)P l+1 + (N - i + 1)P 4 _!] 

+ s[-2i(N - i)Pi + {i + l)(N-i- l)P i+1 

+ (i-l)(JV-i + l)Pj_i], (15) 

where Pi is the probability with which the number of 
^4's is i. We can derive the corresponding Fokker-Planck 
equation: 



+ 



dx 2 



k^ 

2 



sx(N -x)\P 



(16) 



and the time-independent solution is obtained as 

P{x) oc [kN + 2sx(N-x)} k/s ~ 1 . (17) 

The same transition phenomenon discussed in the previ- 
ous sections is easily seen to be at s = k, which has the 
uniform steady solution Pi = 1/(N + 1). We note that 
the change of the volume V in the random walk model 
in § 3.1 has the same effect of both changing the number 
of particles and the rate of one of the reactions. 

In the analysis of this effective model, we used the 
Fokker-Planck equation, which is based on the assump- 
tion of the large system size. Despite this, the same tran- 
sition phenomenon can be observed, which indicate that 
the discreteness property would not be important for the 
transition phenomenon. We will discuss transition phe- 
nomenon in more detail in the next section. 

3.3 Discussion 

From the random walk model and the effective model, 
we have the following remarks. 

First, in order to cause the transition phenomenon dis- 
cussed by Togashi and Kancko, the vanishing effect of the 
fluctuating force near the boundary, where the number 
of particles becomes zero, is important rather than the 
discreteness property. It may be difficult to image the 



effect of the vanishing fluctuating force by only the nu- 
merical experiments in § 2; one might consider that only 
the increase of the internal noise with small V is impor- 
tant. By the discussion from the random walk model, 
it became clear that the decrease of the internal noise 
near the boundary is also important for the transition 
phenomenon. 

Secondly, from the analysis of the effective model in 
§ 3.2, it is easy to see that this effective model can cause 
the same transition phenomenon. In addition, the solu- 
tion of eq. (17) does not include the discreteness, because 
we use the Fokker-Planck equation with the assumption 
of the large system size. Then, we can conclude that the 
discreteness would not be important for the transition 
phenomenon. 

In the absence of noise, there is only one stable fixed 
point. Hence, rate equations, which does not include any 
noise effects, do not evaluate the transition phenomenon. 
However, the internal noise in the random walk model 
produces "quasi-absorbing states" 16, at the n — and 
n = (s\ + S3)V points; when the random walker in near 
these boundaries, the strength of the internal noise be- 
comes weak, so that they tends to stay such region for 
a long time. While there is a potential which has the 
minimum at the fixed point, the random walker escapes 
the potential minimum due to the increase of the inter- 
nal noise, and it is trapped at the quasi-absorbing states. 
From the above discussions, we conclude that the transi- 
tion phenomenon is caused by the quasi-absorbing states. 

4. Conclusions 

In the present paper, we studied the transition phe- 
nomenon induced by the internal noise. We proposed a 
new chemical reaction network, in which the effect of 
the internal noise is invisible in the deterministic rate 
equation. By the numerical experiments, it was con- 
firmed that the chemical reaction network causes the 
same transition phenomenon discussed by Togashi and 
Kaneko. 11 ) In order to study the transition phenomenon 
analytically, the random walk model and the effective 
model were introduced. From the discussions for these 
analytically tractable models, it was clarified that the 
quasi-absorbing states, which are produced near the 
boundaries, play important roles for the transition phe- 
nomenon, rather than the discreteness effects. 

The transition phenomenon discussed in the present 
paper is caused by the quasi- absorbing states, and we 
therefore consider that the transition scenario is novel. 
The decrease of the volume or the increase of the rate 
constants makes the internal noise large, so that the sys- 
tem escapes from the potential minimum. On the other 
hand, there are quasi-absorbing states in which the sys- 
tem tends to stay for a long time. Hence, the bifurcation 
of peaks in the probability distribution arises. In addi- 
tion, due to the quasi-absorbing states, one peak does 
not gradually splits into two peaks, but the bifurcation 
of peaks occurs discontinuously. This behavior of the bi- 
furcation is the same one as the Togashi-Kaneko model. 
Because the Togashi-Kaneko model has four chemical 
substances, there might be different points between our 
simple model and the Togashi-Kancko's one. In order to 
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clarify the rich phenomena of the Togashi-Kancko model, 
it would be more powerful analytical method. However, 
we believe that the concept of the quasi-absorbing states 
plays a key role in the transition phenomenon, even if 
there are a lot of chemical substances. We expect that 
this new mechanism for the transition phenomenon will 
be important for the study of the statistical physics, es- 
pecially biophysics. 
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